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ABSTRACT 

Following a review of recent research in the 
University of Washington Departaent of Psychology project. Individual 
Differences in Cognition, analyses are reported linking perforaance 
in laboratory studies of cognition to perforaance on selected 
psychoaetric instruaents. Intent of the study was to provide an 
eapirical followup of Car roll s»s (1974) careful analysis of the 
inforaation processing requireaents of tests of cognitive factors. 
The results provide general support for Carroll's conclusions and 
suggest that a resolution of the long standing psychoaetiric question 
of whether aptitudes or achieveaents are being assessed can be 
realized through studies designed to survey individual differences in 
current inforaation processing capabilities. (Author/lfR) 
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Following a review of recent research in the Department of Psychology 
project. Individual Differences in Cognition, analyses are reported linking 
performance in laboratory studies of cognition to perfozioance on selected 
psychometric instruments. Intent of the study was to provide an empirical 
follow-up to Cflurroll's (l97^) careftil analysis of the information processlJig 
requirements of tests of cognitive factors. The results provide general 
support for Carroll's conclusions and suggest that a resolution of the long 
standing psychometric question of whether aptitudes or achievements are 
being assessed can be realized through studies designed to survey individual 
differences in current information processing capabilities. 

^Fart of a aymposim. Individual Differences in Cognitive Style, 
presented at the Aaiarican Psychological Association 83nd Annual Convention, 
New Orleans, 30 Augu&t 197^. The research reported was sponsored by the 
National Institute cf liental Health, Grant WH 21795 to the Dep?,rtment at 
Psychology, ltoiver«ity of Washington (Eairl hunt, Principal Investigator). 
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The research I am going to discuss today is drawn from a long-term 
project under the direction of Earl Hunt at the University of Washington, 
a pro;}e'-.t we style Individual Differences in Ctognition. Dr. Hunt, with 
an expfeixmental baclsgroimd, and I, from a psychometric persuasion, under- 
took this work out of a conviction that it ou^t to be possible to 
establish sooe correspondence between measures of individual performance 
along dimensions implicit in modem theories of hum:*n cognition, particu- 
larly theories of memorial organization and operation, and measures of 
intelligence or cognitive abilities. After all, both are concerned with 
the processing of ..nfonoation. if such relations can be established they 
would be of interest both to the cognitive iAeorist and to the psydJooe- 
trist. For cognitive psychology the message would be that individual 
differences in intelligence are well-established and need to be mirrored 
by individual differences in parameters postulated for any cognitive 
theory. For the psychometrist the ejcpectation is that assessment of 
purely normative individual differences in global performance can be 
replaced by individual differences which can be expressed in terns of a 
processing metric (time, capacity, rate) required by a theory of informa- 
tion processing. In short, we seek either a theory of cognition that 
takes individual differences into account or a means of assessing 
individual differences with some theoretical basis. 

We are working within the frduoewoxlc of a distributed memory model 
{Hunt 1971, 1973). Briefly characterized, the distributed meoiory model 
is coDceined with the buffering of sensory information into central memory, 
receding of information within and between memory stages, retrieval of 
information from memory, and the cross-referencing and oxaparison of 
information stored in memory. Human information processing is likened 
to a computing system with control processes manipulating information 
stored in a data structure sub;}ect to the constraints of the brain* s 
system ardiltec^ure. Between individuals, differences in cognitive per- 
formance can be contributed to by diffei'ttsitial characteristics of the 
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physical syatea, by differences la availability or effici«icy of control 
processes, or by differences in the or^nlzatlon of the data structure. 
Hov might differences of these kinds relate to tested differences, for 
example, in verbal intelligence or spatial ability? 

Review 

Although our earlier Motis. is described in greater detail elsewhere 
it may be helpful to briefly review it before describing any new results. 
In our first series of studies (Hunt, Frost, and lunneborg, 197?) 
number of experimental p«uradlgms liaportant to the developiaent of tbe 
distributed meiaoxy model were replicated with tested psydioisetric intel- 
ligence Included as an independent variable. For these studies subjects 
were recruited from among university freshmen ii^o as hi^ school Juniors 
had taken a test battery of ten intelligence related measures. Only two 
of these psychometric scores, however, were en^loyedr Verbal Ability, a 
coo^site score from four separate verbal subtests, and Quantitative 
Ability, a ccmipoalte score from five numeric subtests. These two were 
selected because of the widespread acceptance of such assessments as two 
of the most io^rtant aspects of intelligence as presently measured. 
Freshmen were recruited who had extreme scores within tbe range of tbe 
Univfcrsity undergraduate population forming four groups, low verbal- low 
quantitative, low verbal-high quantitative, higjx verbal-low Quantitative, 
and high verbal-bigjh quantitative. Low and high were defined aa within 
the bottom or top quartile of Univeraity scores. 

The experiments selected for replication dealt eitber with 
short-term meoiory iSTti), vbich holds stimulus-bound codes for a period of 
seconds, or with intermediate- term memory (ITM) which holds a seiaantic 
code for a period of several minutes to perhaps an hour. An overview of 
results of those eicperiments suggested two consistent, intelligence- related 
findings. 

^* Hig|li verbal ability is associated with fsreater efficimicy of 
short-tern memory . (A) Hlg^i and low verbal subjects were tested using 
tbe varied set procedure of tbe Sternberg (1970) paradi^> From one to 
five digits, a memory set, were displayed simultaneously for three seconds. 
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Two seconds later a probe digit appeared. Subjects were asked to report 
vrtiether the probe was in the menory set or not. Besponse latencies were 
detemined and high verbal subjects were determined to have significantly 
faster search rates than low verbal subjects. Hi^^y and low quantitative 
subjects did not differ. 

(B) In the Posner matching taak (Posner and Boies, I97I) subjects 
looked at a letter followed, with an interstianilus interval of zero 
seconds, by a second letter. Under one condition, the phys:.cal match 
condition, the subject responded "same" if the two letter, f»re physi- 
cally the same (e.g., AA), lAile in the name match condition the subject 
responded "same ' if the two letters had the same nsme (e.g., A and aA). 
Analysis of latency of response results suggested the hig^J %'irbals had 
faster access to names than low verbals. No difference was obtained for 
the physical matching task nor were the high and low qixantitative groups 
differentiable. 

(C) Two other studies, siiggested by the findings of Wickens (19T0) 
with proactive inhibition and Puff (1966) with semantic clustering, had 
the following results; high verbals were more effective in holding onto 
the temporal order of elements in short-tem memory, and secondJiy, in 
recalling a randomized list of categorlzable names (animal, vegetable, 
mineral names), low verbals clustered while high verbals receOled the 
items more in order of presentation. 

2* High quantitative ability is associated with greater resistance 
to loss of information throu^ interference . (A) In the Atkinson and 
Sbiffrin (1968, 1971) continuous paired associates task subjects are 
asked to keep track of the changing association between each of a small 
set of fixed stimuli (four consonant-vowel-consonant trigrams in our 
replication) and responses randomly selected from a large set (here digit 
pairs between 01 and 75)- Extreme verbal-quantitative groups were admin- 
istered 150 trials following initial pairing of trigrsms and digit pairs. 
In each trial subjects were asked to respond to one of the selected tri- 
grams with the associated digit pair and that trigram was then assi^ed 
a new numeric association. Lags between pairing and subsequent recall 
varied from 1 to Ik intervening trials. Analysis of correct and error 
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responses over the several lass pemitted the estimation of four memory 
parameters for each subject: probability that an item will enter 
short-term memory; number of items that may be held in short-teim memory 
at one time; rate of transfer of information from short-term to 
intermediate-term memory; rate at which information becomes unavailable 
from intermediate term memory. The first three parameters are considered 
to be affected by the subject's choice of strategy for handling the exper- 
imental task. The measure of effective loss of information from inter- 
mediate-term memory, oii the other hand, is presumably a measure of the 
extent to vhich one is distracted by incoming information after an item 
has been fixed in memory and, .s such, may be leas under the subject's 
control. It was this last parameter that was related most strongly to 
the intelligence score groupings. Rate of loss of retrievable informa- 
tion from memory was reliably lower for subjects in the high quantitative 
groups. 

(B) Similarly, in a replication of the Brown-I-eterson paradigm 
(Peterson and Peterson, I959), high quantitative Ss were cooslstcntly 
better in recall following a distracting task. And, in an analysis of 
our colleague Tom Nelson's long-term meroory (LEi) data (Nelson, 1973), 
while verbal ability predicted rate of learning, quantitative ability 
predicted retention over 5 weeks of paired-associates. 

In our second series of studies (Hunt, Iimneborg and Lewis, .197^) 
we sou^t to explore a little more thorou^ly the finding that high 
verbals appeared to manipulate information in short-term memciy more 
rapidly than low verbals. These studies were again conducted by recruiting 
and paying two groups of University freshmen, one tpx>up whose hi^ school 
test scores placed them in the top quarter of University freshmen in 
verbal ability and a second group whose scores placed them in the bottom 
quartile. Ihese hig^ and low verbals peurticipated in six experiments 
**iich I will briefly characterize under three hypotheses. 

^* verbal ability is associated with greater speed of acce ss 

*2 overleamed codes . This hypothesis w«*s suggested by the results 
obtained on the Posner task in the first series of experiments and that 
task was repeated in two versions. In one the stiaultis materl.als were 
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presented by computer display, and in th*5 second, Ss sorted cards bearin^i 
pairs of letters. The same 20 high and 20 low verbals were in both 
studies. In both instances an analysis of variance revealed a signifi- 
cant interaction between name vs. physical match with verbal ability- 
high verbals had a decided advantage under the name identical conditions. 

The third study under this hypothesis had eight high and eieJit 
low verbals recall, following a short interpolated tasJc, lists of letter 
clusters which had been exposed a cluster at a time. iSnbedded in certain 
of the lists were adjacent letter clusters which would make up a word. 
The basic finding was that while there was no difference between high 
and low verbals in the recall of clusters which did not fona words, hi^ 
verbals were significantly better than low verbals in the recall of 
word-foiming clusters. High verbals were able to make use of the 
word- forming nature of the clusters, while low verbals were not. This 
finding persisted when the results were corrected for differential 
familiarity with the words in the lists and for differential success in 
recalling words from vrard lists presented in the same experimental setting. 

2. Hi^ verbal ability is associated with better retention of order 
information . (A) The first experiment assessed V^z ability to maintain 
order information in STti in a situation in which semantic content was 
not a variable. A variation of the well-known Peterson and Peterson 
(1959) technique was used. Four letters were shown in sequence on a 
computer display screen followed by a variable niuober of digits. The 
subject named each character as it appeared and was th«i asked to recall 
the letters in the order in which they had been presented. Twenty-four 
hie^i and 25 low verbals participated, itesponses were analyzed by position 
within the list of recalled items and by length of the intervening string 
of digits. Two types of errors were identified— transposition errors 
(correct letter out of place) and non-transposition errors (letter re- 
ported that was not shown). Low verbalr juade more errors of both types 
than high verbals regardless of the amount of retroactively interfering 
material. The high verbals' advantage decreased, however, as the number 
of intervening digits increased. 



(B) A second study by Poltrock in our labormtory used quite a 
different method for studying sensitivity to stimulus order, a method 
which requires a little explanation. Ru-^^ Day has reported that if a pair 
of speech sounds are presented separate o the right and left ears, 
right-boaided Ss will be biased toward perception of the stianulus in the 
right ear as being the leading stimulus, even thou^ it may have lagged 
the left ear stimili by 50 milliseconds fDay, Cutting and Copeland, 1971). 
A sijailar left ear (right brain) bias has been shown for perception of the 
temporal order of pure tones of varying pitch. Iiunt has proposed that the 
determination of order occurs when a recognized stimulus arrives in STIi. 
As recognition of speech sounds should occur in the left brain speech 
center, a speech sound in the right ear wvxild thus be recognized directly, 
whereas recofsnition of a speech sound presented to the left ear should 
require transfer of information across the cerebrsil commisuTe. This 
would account for the right ear bias for perception of the temporal order 
of speech stimili. The extent of the bias should depend upon the speed 
of c ommun ication of information within the brain- In generail, the faster 
the information transmission within the brain, the less the bias toward 
favoring the right ear. If hie^ verbals are in fact capable of more 
rapid internal transmission of information, then they should show less 
of a bias in favor of the right ear. 

Three groups f subjects were used including a middle verbal group, 
16 Ss in each group. High verbals were indeed more accurate in the per- 
ception of speech sound order (the stops ba, da, and ga). They showed 
effectively no bias in favor of the ri|^t ear. Howfrver, there were no 
differences between the groups in judging temporal order of non- speech 
stimuli (buzz, hiss, tone). 

5* Miigfe verbal ability is associated with more rapid processing of 
iuformation in simple-problem solving tasks. (A) In the first study we 
used a modification of the task first proposed by Clark and Chase (I9T2)* 
The subject lead a simple assertion about a picture (* above + , + not 
above *) and then looked at a picture and reported whether the assertion 
was accurate or not. The times taken to read the assertion, encoding 
time , and to make the true- false judgnent, decision time, were recorded 
and amJyzed as a function of the complexity of the assertion and 



its accuracy. Each trial can be described by statixie (1) whether the 
sentence is true or false about the picture, (2) vhetber the sentence con- 
tains the unmarked preposition "above" or the narked preposition "below/' 
and (3) whether or not the sentence contains the word 'not.*^ Other 
studies have suggested that "true" responses are made more rapidly than 
"false ' responses, that the maxiced form of a preposition is more diffi- 
cult to process, and that it takes longer to process a negation 
(Trabasso, 1972)' An analysis of variance of data from 10 high and 10 
low verbals for both decision and encoding tijmes indicated that virtually 
all the variance was due to (l) the true-false distinction (decision 
times only), (2) the ne^tion effect, and (5) the interaction of the 
negation effect with verbal ability. VRiile the marking effect did not 
reach statistical significance, low verbals took almost twice as long as 
high verbals to process a negation. Importantly enough, this was txn^ 
for decision time as well as for encoding time. High verbals continued 
to have an euivantage even after the assertion bad been reeul or encoded. 

(B) The final experiment from our earlier series is similar to 
the Clark and Chase task in that it involved a problem task ^^ich can 
be made more complex. In this '9ti:dy 2k hi^ and 2'^ low verbals were 
asked to complete a series of mental addition problems. Each problem 
required that the S "take in" a first term and then, when that was com- 
pleted, to take in a second term and report the sum. As with the Clark 
and caiase task, time to encode the first term and time to report the sum 
were separately uieasured. The problems were differential complexity 
along two dimensions, number baae and necessity for a cewrry operation. 
i:ase was manipulated by asking subjects to add digits (base 10), days 
of the week (base 7* Itonday taken as the first day), months of the year 
(base 12, January the first month), or letters of the English alphabet 
(base 26, A, the first letter). While Monday + Wednesday » Thursday 
does not involve a carry, November + June = May does. Although there 
was little difference between hi^ and low verbals in time taken to read 
the first addend, high verbals had a progressively greater advantage in 
time taken to complete addition as the problems became more complex — 
carry vs. no carry in the same base or base changing from decimal to 



week, to month, to alphabet. All thrae of the hypotheses relating to the 
superiority of high verbals were borne out. 

Aidltional Work 
These f indinss with respect to hi^ and low verbals are very 
challenging if one recalls what it means operationally to be labelled hi^h 
or low verbal. The four tests employed to produce the Verbal Ability 
score were Spelling, Vocabulary, English Usage (crammar and punctuation), 
and Reading (paragraph) Comprehension. While there is n speed of proces- 
sing component to these, as to most psychometric measxires, one is struck 
by the fact that for nearly all there is assumed to be something know, 
some specific contents in the long-term memory store, which is important. 
VJhat distinguishes the high from the low verbal is, on the surface, 
knowing the spellings of words, meanings of words, rules by which words 
are put together, and knowing how to extract meaning from strings of 
words. Yet we have found consistent differences associated with verbal 
ability which are not dependent upon the contents of LTM, but largely 
upon rate of processing of information in SThl. \^ is this true? 
Although it is tempting to speculate that it is the high verbals' greater 
information-processing efficiency that permits *he relevant ccmtents of 
mi to be built up more rapidly, we aren't prepared to say that is the 
answer. What we are prepared to say, thou^, is that studies ILke these 
may help unravel problems of this kind. The question of whether individ- 
ual differences are due to differences in WA contents, or to differences, 
say, in STH operations is an ancient and honorable question in psychomet- 
rics. In psychometric terms we worry about whether we are measuring en 
aptitude or an achieveiaent. Although there is fairly general agreement 
that both "things" exist, the proceedings of a recent conference on the 
"aptitude-achievement" distinction (Green, 197^) suggest that we are far 
from agreement on what constitutes an appropriate measure of which con- 
strue t or, indeed, whether the two constructs are measurable. Some 
appreciable part of the problem, we believe, is that aptitude and achieve- 
ment tests have been constructed without reference to any cognitive 
theory. As we become more successful in designing measures keyed to our 
best guesses as to how man processes information, we hope that this 
problem will vanish. 
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We aren't there yet but there is growing interest in getting there. 
While we have taken one tack in the attempt to build bridges between 
the psychometric assessment of individual differences in cognition, on 
one hand, and models of information processing on the other, John Carroll 
has developed a second strategy which should be complementary and the 
additional results I wxauld like to discuss today are from analyses stimu- 
lated by his work (Carroll, 19TU). Tl studies I have so far reported 
have involved taking measures suggested by a model of information 
processing and seeing whether psychometric types differed on those meas- 
ures. What Carroll has done is to take a representative sajnple of 
psychometric tests, those assembled in the Kit of Reference Testa for 
Cognitive Factors (French, Ekstrom, and Price, 19^5 ), and to exandne each 
with respect to the sajue distributed memory, information-processitg model 
we have employed. This permits him to characterize each test with respect 
to the demands that test makes on an information-processing system. More 
specifically, he identified those information-processing characteristics 
which would be expected to show individual differences and which would 
affect performance on an item in the test. 

What these characterizations suggested to us was a framework within 
which we could look at relations between oxir laboratory measures of 
information processing and the test performance of our subjects. The 
study I am about to describe is the first attaipt to do this. The data 
had been collected before we learned of Carroll's work and were also the 
first data obtained after we computerized part of our laboratory proce- 
dures. As a result of this latter circumstance the gremlins ate a part 
of our data. We don't have the data, thfji, we would have if we set out to 
design the study today. We think, however, it wiH serve to illustrate 
the approach. 

Itetbod 

Subjects ; Sixty-four high school age subjects from the Seattle area 
were recruited summer 1973 via a caanamity Job line. In groups of eight 
they spent half a day on each of two consecutive days in our laboratory. 
During each session they participated in several short laboratory assess- 
ments and completed a battery of short paper and pencil tests. Subjects 
were paid on an hourly basis for their participation. 

o 
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Psychometric Instruments ; The seven tests may be briefly described. 

1. Verbal Comprehension , KAS test 1, calls for the subject to select 
a synonym from among five alternatives for each of ^0 words. Five minutes 
are allowed to work on the task. As with the other multiple choice tests 
in this battery the score is the number of itema answered correctly minus 
a fraction of those answered incorrectly. In the Reference Kit scheme 
this test measures Factor V, Verbal Comprehension. 

2. Numerical Ability , EAS test 2. Part 1 contains 25 items of the 
fom "IC + 18 « " with the answers to be selected from five alter- 
natives. Two niiiutes are allowed on this part. Part 2 consists of 25 

problems of decimal fractions, for example, "1.6 x O.J « Four 

minutes were allowed for this part. The two parts provided a single 
score. This test measures Factor N, Nuinber Facility. 

5* Space V isualization . EAS test 5, presents the subject with a 
series of ten line drawings. Each drawing depicts a stack of blocks and 
the subject's task is to report, by marking on an answ r sheet, for each 
of the labelled blocks the nuinber of other blocks in the stack that arc 
in contact with it. Five minutes are allowed and the score is the nuinber 
of correct counts completed. The test is considered a measxire of Factor 
Vz, Visusilization. 

^' Numerical Reasoning , EAS test 6, presents subjects with twenty 
number series. The task is to select the next, eighth element from 
among five alternatives. 

This test taps Factor I, Inductiai, as well as NUPber Facility- 

5* Verbal Reasoning, EAS test 7, is a deductive reasoning test and 
a measure of cognitive factor Rs, Syllogistic Reasoning. Subjects are 
presented vith a set of four facts followed by five conclusions and asked 
to report for each conclusion whether it is true, false, or of indetermi- 
nate validity. Six such exercises may be attempted in the five minutes 
testing time. 

6. The iiinnesots Clerical test consists of two parts each yielding 
a separate score. In part 1 subjects compare pairs of nximbers (from 5 to 
12 digits in length) snd check the pairs which are the same (3 minutes). 
The second part of the test is identical except that the pairs consist 



of names of individuals or businesses, and again, this part runs for 3 
minutes. OSiese Clerical Numbar and Clerical Name scoras should both tap 
Factor P, Perceptual Speed. 

?• Hidden Figures is an eaqperijnental test included in the Reference 
Kit as a measure of Factor Cf, Flexibility of Closure. Sub^i'^cts are 
presented with five polygons anc: asked to determine for each of sixteen 
complex line drawings vihich polygon is hidden in the complex figure. 

Laboratory Measures : Our "marathon" laboratory sessions involved 
subjects in several settings. Qal^ those which provided measures for the 
present analyses, however, will be described here- 

^* Motor Hff a ction Time was the median time taken to respond by key 
press to the onset of a + on a CRT screen. 

2. A choice reacticaa tiine study provided a median time to respond 
"^iscriminatively by depressing a left or right key to two stimuli, a 
lircle appearing either in the left or right half of a CRT display. This 
choice reaction time was not itself employed in the present analysis. 
Rather a variable called Choice Time was defined as the difference between 
the median choice and motor reaction times. 

5. The choice reaction time study above also provided a seccnd 
variable for this aiialysis : proportion of trials on which the correct 
choice was made . 

k. In the Ptroop task sub;Jects were asked first to report orally the 
colors in which a series of asterisks were printed and then report the 
color of printing of an equivalent length list of contrasting color names. 
The task was repeated twice and the score used here was the average 
difference in " reading" tiioes between the name and asterisk conditions. 

5 and 6- In an experiment In the Sternberg (1970) paradigm Ss were 
sequentially shown from one to six consonants and then shown a single 
probe consonant and asked whether the probe was in the previously exposed 
set. Respcose time was recorded and, for correctly identified instances, 
these times linearly regressed on the number of digits in xite associated 
target set. For each S, then, a slope and intercept value were obtained. 



7 and 8. strings of fifteen digits were presenter* binauxally to Ss 
with recaU cued iaaediately foUowing presentation. In recall Ss wre 
instructed to recall in order as many digits as possible beginning with ^ 
the first digit heard. Ten trials were presented with each scored for 
the puober of digits recalled in order. In this analysis two scoi'^s were 
employed-a Digit S£an, Final score (average of performances on the last 
five trials) and a Digit Span , Gain score (difference between the Final 
average and the average over the first five trials). 

9 and 10. In a task patterned after Massaro (1972) four digits and 
four consonants were pretaited dichotically, two digits and two conso- 
nants to each ear. Following presentation Ss were cuad to recall the 
presented material, (to some blocks of trials Ss were t^ report by ear, 
i-e., report what they heard to the right ear or the left ear. Cfa other 
blocks they were asked to report by category, either digits or consonants. 
While they knew Aether they were going to hav« to recall by category or 
by ear, which category or lAich ear was not cued until after the- presen- 
tation. Two scores were extracted for the present analysis. The 
Category Score gives the number* of items correctly reported over aU kO 
category trials. An Ear Minus Category Score was obtained by subtracvxng 
the category score from a similar score obtained from the ear trials. 

11-14. A final set of four scores was obtained ir-om a study of 
clustering in recall of a list of nouns based on the experimental para- 
digm of Puff (1966). During their first laboratory session Ss were 
shown item by item, two Usuh of 50 common nouns. Each list was showp. 
twice with subjects aslced for recall immediately following each presen- 
tation (four recalls). Each list consisted of ten nouns each frcm three 
semantic categories (fruits, occupations, animals, etc.). For half the 
subjects the list presented first was blocked, all ten messbers of a 
given category appearing contiguously, and the list presented second was 
in pseudo-random order. For the other half of the Ss this order was 
reversed. When Ss returned for their second day in the laboratory they 
were asked to recaU each of the two lists (two more recalls). A clus- 
tering score was computed for each of these six recalled lists. In the 
present analysis four transformed scores w9re employed: (l) The clus- 
tering immediately following the second presentation of the blocked list 



provided a base scsore, Bl; (2) this base clxiBtering minus clustering for 
second presentation of pseudo-random list, Bl-Rl ; (5) base clustering 
minus clustering for second day recall of blocked list, Bl-B2 i and (k) 
second day blocked clustering minus second day random clustering, Bg-R2 « 

Results 

Correlations bet-een the psychometric and laboratory data are shown 
in Table 1. The response time measures— Motor R T, Choice Time, the 
Stroop measure, and the two scores from the Stemoe*^ task — correlated 
negatively with paper and pencil test performance, as might be expected. 
Proportion of correct responses in the choice reaction time task corre- 
lated only weakly, though positively, with the psychometric measures. 
This laboratory measure had little variability, however, as few errors 
were made (average proportic^n correct was .95)- The negative correla- 
tions involving Digit Span, Gcin suggest the possibility that, as 
improvement on the average was small (from 5.75 digits to 6.25 digits), 
big gains were registered tjy those who hid not done well in the Initial 
trials. Tbe digit span score itself was not highly correlated with any 
of the psychometric oeasuxes. 

The Category Scores from the dichotic listening task correlated 
positively with nearly all of the paper and pencil tests. Raw ear scores 
were considerably smaller than category scores (rou^ly 70 as opposed to 
90 on the average). The pattern of correlation for the Ear Idinus Cate- 
gory scores suggests that highest psychometric scores were earned by Ss 
whose category performance far outstripped their ear perfonnance. 
Finally, the Clustering Score is such that low scores (actually large 
negative scores) indicate greater clustered recall. Except for the 
reversal of signs the pattern of correlations for the clustering on 
immediate recall of the blocked list (Bl) is quite sijnilar to that for 
the Category Score from the dichotic listening task. The difference in 
clustering scores between the immediate recall of blocked and randomized 
lists (Bl - Rl) was not well correlated with any of the psychometric 
measures. (Clustering was, of course, greater for the blocdted than for 
the random list. ) Clustering for the blocked list was almost exactly 
the same for delayed as for immediate recall (the score Bl - B2 in the 
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tat -a had a mean close to zero). This difference, however, did correlate 
with a number of psychometric measures. Increased reUance on semantic 
clustering between immediate and delayed recall tended to toe negatively 
related to certain paper and pencil test performances. The last measure 
included in Table 1, B2 - K2, the difference in clustering of delayed 
recall between the blocked and randomized lists had near zero correlations 
with the psychometric measures. (For the randomized list, however, clus- 
terine was considerably greater on the average for delayed than for 
immediate recall.) 

Table 1 reports the zero order correlations between laboratory and 
psychometric measixres. Because many laboratoiy measizres are themselves 
not pure measures of information processing parameters— for example, 
clustering score Bl imy be interpreted as a measure of short-term serial 
recall ability as well as any sauantic clustering tendency— these corre- 
lations are more equivocal than we would like. The laboratory perfom- 
ances were correlated among themselves. This is reflected in Table 2. 
The quidsness of response measures— 1, 2, k, 5, and 6— tended to be 
positively correlated. Clustering on immediate recall of a blocked list 
had a sizeable negative correlation (-55) with the category score in the 
dichotic listening task. Tables 1 and 2 provide the essential data for 
the generation of the results we would like to report. 

What we are attempting to eaqjlore in these systematic stepwise 
multiple regression analyses is a quantitative analog to Cfiirroll's (iS'Jk) 
point about the information processing or memorial complexity of most 
paper and pencil tests. CXu* strategy was to order the laboratory measures 
by level of con^lexity ranging from the motor reaction time measure, ^ich 
places the least load on memorial operations, to recall measures in the 
dichotic listening and clustering studies. Then, we asked of the data how 
much of the inter- individual variability in perfonaaace on each of the 
paper and pencil tests could be accounted for successively by the inde- 
pendent contributions of the several laboratory measures, working up from 

the least complex. The results are in Table 5* Entries in the columns 

2 

headed R are cumulative proportions of variance accounted for. itotor 
Reaction Time accounted for l£ff> of the variance in the Verbal Comprehen- 
sion scores; iiotor Reaction Time plus Choice Time accounted for 225^» of 
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the variance, etc The delta entries ere the increments, the additional 
proportion of variance accounted for. It is important to keep in mind 
that these increments are for partial Yariables. The contribution of the 
Choice Time variable, for example, is the contribution of that measure 
after it has had partialled from it the influeice of I.iotor iteaction Time. 

Figure 1 is a Rimplication of the dat* in Table 3. The measures 
have been grouped as shovm by the letters along the right edge of Table 
3. Thus, A indicates the variance accounted for by the ilotor Reaction 
Time; B is a measure of the amount of additional variance accounted for 
by the remaining response time measures: C is the contribution of a 
carefulness-of-response measure— proportion of correct responses in the 
simple, two-choice reaction time study; D carries the incremental con- 
tribution of the digit span study; E does the same for the dichotic 
listening taslc, and F and G bring in, finally, am remaining contribution 
of the clustering on recall scores- 

Discussion 

What can we say about these results? Before looking at each of the 
test entries in Figure 1 and at Carroll's characterization of what is 
important to doing well on them, let us n^te one potentially confounding 
factor. As Carroll USJk) properly noted, the time limit on a test intro- 
duces a speed component to test scores of some magnitude. Because Carroll 
addressed himself to the question of what is important in responding to 
^ 1^62 rather than to a speeded test as a whole, we might expect that a 
generalized measure of response time would be a more significant deter- 
miner of total test performance than of success with a single item. That 
is, the component labelled "A" in Figure 1 may be inflated. 

S£ace Visualization. Carroll characterized Factor Vz as dependent 
on a process occurring in STM whereby a spatial representation is 
"mentally" transformed. This process is assumed to produce both capacity 
and rate differences between individuals. We have nothing in the labora- 
tory measures that speak to the question of capacity for spatial represen- 
tation. However, the rate at which this representation can be manipulated 
could well be not a unique rate but one dependent upon more general sm 
processing rates, based upon the appreciable individual differences 
accounted for by the time components A and B. 
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Numerical Ability. Factor K requires retrieving number associations 
and arithmetic algorithms from LIM and performing serial operations on the 
stimulus materials using the retrieved algorithm. Individual differences, 
Carroll noted, appear in both content and temporal aspects of the re- 
trieval and manlp'xUtive operations. Carroll also felt that special 
strategies, chunkin?? numbers, for example, may also contribute to individ- 
ual differences. It would be nice to be able to assert that all high 
school juniors know how to perform these arithmetic tasks, that they all 
have the requisite store of algorj.thms in vm. It may be overly optimis- 
tic, however, to do so. Rate, either of retrieval of an algorithm and/br 
of application of the algorithm is important and could well be detemined 
by the general processing rates that are assessed in A and 

Numerical Reasoning . The number series problems were most akin to 
Factor I, Induction, suggested by Carroll to require searching a general 
logic stor^ in UM for relevant hypotheses- The ma^Jor detcxminer of 
success is \diether the contents hold the solution. Sooc subjects, 
however, might construct new hypotheses by serially operating upon STM 
contents- A substantial amount of the variability in this test is 
accounted for with no knowledge of the contents of an lOM logic store- 
Perhaps the range of inductive hypotheses likeOy to be employed is 
limited enou^ by the problems and subject sampling to not be a source 
of individual differences. The importance of speed, again, plus the 
relatively heavy contribution of the dichotic listening and clustering 
scores siiggests that operations on STM were indeed contributory to success 

Verbal ReasoninS ' Representative of Factor Rs, Syllogistic 
Reasoning, this test would require by Carroll's analysis retrieval of 
meanings and algorithms from LKI and the performance of serial op rations 
in sm on the retrieved materials. Individual differences in content 
and temporal aspects of performance are postulated. There is some like- 
lihood, as well, that Ss vary in attention paid to details of the stimulus 
material. Results for Verbal Reasoning are in interesting contrast to 
those for Numerical Reasoning. That only a relative?y small proportion 
of the total variance was accounted for, together with a depressed contri- 
bution of the processing rate measures, suggests that indeed it is 



individual variability in the contents of some ITH store (rather than the 
speed with which it can he accessed) that accounted for individual differ- 
ences in perfoiraance. An alternative explanation would be individual 
variability in performing transformtions of statonents prior to evaluating 
their logical consistency. If E, F, and G measure a general class of such 
transformations, then their small contributions to Verbal Reasoning argue 
against this alternative. Final Jy^ if C, the contribution of carefliljiess- 
of-response is interpreted as "attention to detail" (appealing in connec- 
tion with the next two tests), then "attention to detail" was not an 
important source of variability in Verbal Reasoning. 

Clerical , Number and Name . Both subtests tap Factor P, Perceptual 
Speed, which should be primarily sensitive to the temporal parameters of 
a visual search through a field for specified elements. This search, 
Carroll posited, occurs by addressing sensory buffers. Failure to 
account for more of the variance in these two tests cannot be laid to 
failure to tap soiae liT?! store. It is, in fact, puzzling that there is 
so much left unacccmnted for. The inference is that the speed of proc- 
essing required in clerical work is not well explained by the speed of 
processing measures tapped by A and B. That C maJtes its gi^eatest con- 
tribution here is suggestive of important individual differences in some 
kind of testing or checking loop. 

Verbal Comprehension . This test and Factor V of the same name are 
synonymous with irtrnt in everyday parlance is vocabulary and Carroll has 
written that performance is almost exclusively dependent upon the contents 
of a lexicosemantic lilM store, upon the probability that S can retrieve 
the correct meaning of a word. What we see In Figure 1 is, of course, 
the same thing that we have found in our earlier studies^ that one can 
account to a very large extent for differences in verbal ability without 
ever inquiring about what Ss may know about the language. I hasten to 
add, however, that being able to account for the variability in vocabu- 
laiy of a group of adolescent native Snglisb speakers may not meet the 
same goal as knowing what an individual S's vocabulary is. The Vocabu- 
lary test example, however, draws rather nicely a distinction (notice I 
do not say the distinction) between aptitude and adiievement measures. 



Tbe size of one's \rocabulary is one measure of that individual's 
achievement. That it is so predictable from measures which are, from 'm 
information processing point of view, more basic than inventorying the 
contents of an LTM store suggests that vocabulary could be supplanted as 
an aptitude measure, however. 

^i<^den Figures . This last test is a measure of Factor Cf , 
Flexibility of Closure, and involves, by Carroll's analysis, an STM proc- 
ess whereby a figure is imaged in relation to a surrounding visual- 
representational field. Both capacity and temporal aspects may be 
involved. The test was, for our sample, a very difficult one— the aver- 
age score was 3.5 out of a possible l6. ISiis is reflected in the rela- 
tively small contribution of the motor reaction time measure— so few 
responses were mac' i by the average S that speed of making the response 
was unimportant. Choice Time was important, as it was for the Spatial 
Visualization and Numerical Reasoning taslcs, st;igge8ting that successful 
test performance requires rapid evaluation of alternatives. Because of 
the purely figural nature of the stimulus material it is interesting to 
note the rather large contributions of E and G, measures which are 
grounded in symbolic and semantic manipulations. The suggestion here 
is that the ability to effect these manipulations is not independent of 
the ability to manipulate figural material. 

Despite the shortcomings of the available data these analyses suggest 
that Carroll's thoughtful analysis of the demands psychanetric tests place 
on human beings as information processors can be fruitfully linked to 
laboratory measures to gain better understanding of what the psychome- 
trists call intelligence and what the experimental psychologist calls 
cognition. If we were to hazard predictions as to the outcome of such 
work they would be two: First, the distinction between assessing individ- 
ual differences in the contents of LTM stores and assessing individual 
differences in abilities to manipulate information (including storage and 
retrieval from HM) will be aaich better understood. Second, as a result 
of this, the number of parameters relating to such abilities will be far 
fewer than the nuiuber of factors— mixtures of information manipulation 
abilities, strategies, and LTM stores— that present day psychometrists 
must deal with. 
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